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ABSTRACT 

The relationship between placeaent of adjunct ^ 
questions in instructional materia 1 and incidental- and intentional 
leandnq wa:^ investigated. A total of 150 undergraduate students 
assigned to five experiaental groups studied ten paragraphs vith 
questions interspersed at different locations in the text. 
Perf oraance on Incidental itens was significantly lever it the! 
question before (QB) than in the questicii after (Ql) , guestion before 
and after (QBA) , and the no-question (NoQ) groups. Perforiance on 
intentional itens by the QB subjects was significantly lever than the 
QA and the QBA subjects. The results also scggest that the QB ^nd the 
QA effects of questions combined additively to produce the 
perfomance of the QBA subjects. A surprising finding indicates that 
although performances differed between the QE, QEA, and QA conditions 
in the immediate recall* ta^k, post reading perfctmance of theifpA and 
QBA subjects became equal and above the QB subjects. This may mean 
that depth-of-processing is the relevant operation ^to fceus upop. 
Educational implications are discussed. (Author/BD) 
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fAidditive Effects 



A. total of 150 undergraduate studenM randomly assigned tp five expeirimental 

groups studied ten paragraphs, with, f^ti^stions -interspersed^, at different 

lac^tions^^l^ the text. Performantift incidental 'item$ Wis significeintly ' 

lower- (£ < .05) in the^ quest ion\b^fo?e (JQB), g^an in the ^jqufestion' after (QA) , 
^ ■ ' ■' ^ ' ' ' ^ 

•question before and after (QBA) , and tli'e no-<i6estion (NoQ> groups. Performance 

on intentional items by the Q§ sub^ect^ Was signif icanti^^^ower <<05>. ' 

than the^4 and the QBA Subjects. The r^suH^ also suggest tljat^ (a), thp' 

"QB and fhfe' QA effects of questions combine ''add it ively^ to produce the; ' 

performance of the QBA subjects, and (b) the attention .operaticm' is equivalent 

■'• • : ' ^ - \ ' 

across condition^^ for intentional items, but ^differs in tetentrion o|^eratxon; 
This may mean that depth-of-processing is the relevant/tjpetation to foc^s 



upon. 



- ■? 




\ 
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Additive Effects of Pre- and Poj^t-Adjunct Questions in Prose Text 
Background ' ^ J 

Under certain conditions 'the incorporation pf questions in instructional 

material (i.e., adjunct questibris) facilitate the amount learned frpm text 

• ' * ■ ■■ r • • ^ 

due to^^eir mathemagenic ^properties (Frage, 1967; 1968a, 1968h, 1968c; 
Rothkopf, 1965, 1966; Rothkopf & Bisbicos, 1967 ; >RiGkards & Di Vpsta-, 1974) . 
The typical experimental paradigm involves placing, questions within (inter- 
spersed) and immediately before (prequestionin^ ot inmiediately after 
(postques4ionihg) a passage. The control (or cbmparison passage) contains 



he text materij^l without questions. Following the reading df^the passage. 



a posttjBst is administered to the learner. The test is comprised of questions 
about /)tbe "Material enc6untered within the passage ([Intentional items) and ^ 
I . "new"//questlons about the material (Incidental items)'. The, repeatjed questions 

//■■•' • ^ . ^ . * ^ : ^ ' /" 

measiire the amount of intentional learning that takes pla^ in the sense 



thay/the information elicited parallels that deem^ in^orXaitt in typical ^ 
claLsroom situations. The "new" items are sampled ftbia what is psychologically 
a domain of knowledge other than that represented bM^ the, repeated qu^tlons. 

.M ' - ' " ' ■ ' 

Knowing the answer to the relevant questions ^es nof necessarily iAply ^ - 
knowing the answers to the "new" items. TOe mew items test the acquisition 



of /knowledge which Us. considei3ed by the autHor^^f the Jtext material' to be 
peripheral to lihe instruction^ objectives defined by the intentional itemsl 
Hejiice, they considered as measures, of^ incidental \Learning. J o\ 

ons between questioned and nonquestibnecW material, 

^ %' ■ . ' " )X • 

^ learning beHavioj^an^ <:«n8«iquent outcomes can be conttollj^edi or shaped. ^ 
i^gus^^^q^^ can modify mathemagenic behaviors,/ by extinguishing |^ ^ 



C^^. •■'1 : ■■■ ' ■■• ••^v- 
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inspection behaviors which fail to result in learning the requisite skills 
for fulfilling the task demands, ^nd btehaviors which result in successful 
per^rmance are strengthened. \ ^ ^ ' ' 

Under postqueation conditions the learner canno{ ^ticipate the questtlHi^s) 
to be asked. Accorciingly, the entire passage must be^read carefully. If 
careful, reading hasjresul^d in successfully answering the postquestioh, 
then the probability of reading th^ next passage in a similar manner will be 
increased. If it has resulted in failure to answer the question, other 
modifications will be made in an^effort to eliminate inappropriatie jeading 
behaviors. Postqupstioning becomes progressively adap.tive with progressive 
increases in s^ess on intentional items and, progx^essively decreases in \^ 
success on ^incidental items. ■ 

Prequestioaing has not been found to facilitate performance to the exfc^lat: 

that poi^'tquestioning has. PositW effects on intentJ.onal items,^ but. not/ on,; 

. ^ ') > ' 

incidental items have been reported by a numberr of investigators (Rothkc^ 

1966; Frasfe, 1967, 1968c; F^rase, B»^trlck & Schumer, -1970; Anderson & ' 

1975; Rickards^l976) . Presumably, they serve as cues to identify relevant 

cont^t, but in tbe process, inhibit' responses to incidental quest ions/a^- The 

depressed scores^ on incidental items may be due to the rejection of ijliformation 

not related ^ answering the questions (Frase, 1968a). " 

The absence of experimental questions has quite' a different mesbage for 

the learner. It implies that all ^nfoirmation within the passage is equally 

important, and the adoption of g^erally successful methods of dealing wlt^ 

such material is essential. * Since the learner's su^jjective interpretation. 

of »the iearning task infiuences his/her objectives, all material within the 
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no^esClon context is considered incidental (to the author: 's int< 



objectives) for purposes of investigation. " ^ 

; From the framework of the cyj>ernetic model of behavior (Frase, 'M69) 
an adjunct question can be, used by the learner to determine whether or^QOt^ 
achieved behavior v(what the student places in memory) coinqides with th^- 
criterion of acceptable behaviors (the correct answer). Thus, a learner^^ ^ 
confronted with a question will proceed to^ad the paragraph to find the 

, ^ ■ . ' . ■ _ . • 

answer. Failure to do so generates an error signal (negative feedback), v 

The error signal has the effect of requiring the learner t9 alter, the strategy 

X. ' - • ^ ■ 

applied to subsequent paragraphs in ord^r to find positive feedback in, the 

' '• . . ' * 

. form of meeting some (exterjially or internally imposed) criterloji. Adjunct 
questioi^, therefore, are more than nominal' stimuli. They beconie e/fe^ctive 
stimuli, directing the students' attention to those res^jonses necessary to' 
correctly answer the question. Furthermore they increase the prftbabilit;y 
that *he learner responds discriminately in unique ways and depending on ^the 
implied objectives, to the passage. ^ ^-x^ 

• ^ ' 

Attention and Retention Opera tipns , ^ > i V 



A further theotet^^ical framework hypothesises- the vexistenc^ Af two ; 



^operations (Boyd, 1973); (a) attention , tRat is, th^^rocess of putti|i|^ 
information into some form of storage whiQ;h becomes operational in iijmediate, 
or nearly immediate recall of information; and (UK^ retention ^^^thit /fg the. ^ 
ability to retrieve the material from storage. Within this view, the pre--^^ 
Question cups the learner to attend more to intentional material than to-/ 
line idehtal material, but the forgetting rate.^ for both 'types ^of nrt^erial^-wiU 

^ tBe same once the material has t>een stored.. Accordingly, p^equesf'ions * 
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influence selective Attention but not selective forgetting, Postqu^^ions 

• "^'V ^ ' " ' ^ ' 

inf lueftJi'e att^ention and retention of incidental material about the ^ame as 

' . ' • r ' ^ ' ^ 

the no-question treatment, but enhances retention >and "retrieval of intentional 

Viterial.. On the basis of sucb evidence Boyd speculated tha^ bhe cds^ 

of pre- and postquestions shouM be adTditivd in. its effects/ Th^s, ^ 1^ 

1 ^ . if prequestidns increase a suMectAs attention ^pVinfcffe 

material and postquestions T^etard the r^t^Jjcy^ forge tl^iftg! for material 

. attepded tOjH^i^^he -effect of giving a's^^^QjE pit^^ 

, ■ ■■ ■ ■ ■ ' ■ ^ \' ' ' ^" - ■ 

, identical pbstciues'tion"^- should be to iftcreq^e^n^^ntisnal posttest 

stques^iorts jWone A 
[i tHe* fail^jre/to find jk. 
bdtwfeen typfe^of-leartiing and average perfcormande' on an eleven-tteatment-matrix. 

• Tike present jstUj^y was dleJsigned to further Ihvestiga'te the Validity of 
the Sidditive model proposed by Boyd coifc:er|^ng, the combined effects of pre-^ 
and po^tque^tioris.. The nypo tresis was that^ the combination of pre- and post- 



scores more t&filtn ^ sfet of\re-. or pos^quesniort^^^one A (p. 32) 

Suppprt for this <;v&w wai^ t)btained through* tHe* failxire/to f ind jtt interaction 



questions would result performance on a posttest vhich was equivalent to 

that of performance under prequestioh aldtl^, plus tha,t of performatipe under post-, 

'question alone. < In order to test this hypothesis adequately, several methodological 
provisions, some ,of which have beep negle^ed in previous studies, were 
provided. These provisions were as follows: - \ • 

1. In order to enhance the ^ieneralizability of results to a genera! 

^ college pop\iiHtion, a heterogeneous sample^^f college students) from a variety 
of sources, were employed. Samplings in tbe past was often madfe from a ^ 



homogeneous target* peculation /(for e'xaiuppre, co^ege sophomore^in introductory 
psychology, office workers, and paid volunteej?^ . Furthermore, the tasks 
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;^ . . ^ ' ' ' ^ 6 

li^'' the present Study were administered under naturalistic study conditions. 

2. Defined procedures were employed, regarding development of an item 
pool corresponding to a "domain" of knowledge and the placement of adjunct 
questions wiDhin the text, 

3. '.The items for the adjunct question^ and for t.he criterion tests were 
selected at random such that there were thirty different forms of the test 
employed and randomly administered to subjects. ^ 

4. In order to provide for comparison of^ results with other studies, 

provision was made for replication groups in the design. 

-> ' . ■ ■ * 

The presentation is made with the hope that s^i^e of these issues may 
^attract furt-her research on this topic for e>>entHal better understanding of ^ 
the processes involved. ^ , m ■ . 

Met*hOd 

Design ^ , ^ 

The 2x5 experimental desigh implied the use of a mix^d analysis of 
variance wit^ ^wo factors: a between-subjects factor consiating of five levels 
of question-placement (all combinations of qu^tipns before and questions 
after, plus two^control\ groups, i.e., "test-only" and no-questions) and a 
within-subjects factor consisting of two lej^els of type-of-learning (intentional 
and incidental).' \ .. \ 

Subjects • ' 

The subjects (n = 150) were volunteer^ from among the undergraduates 
matriculated at a land'grant eastern university. Some (n = 13) came from an 
introductory educational psychology course for which course credit could be 
earned by participating in the project. The remaining subjects (n = 137) 
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'were students living in the university residence halls and were not enrolled 

■ y 

in the. introductory educational psychology course. Each subject was randomly 

•■ , . . ^ , 

assigned, by reference to a table of rand.om digits, in one of the five 

'\ . / . 

experimental treatments, with the restriction of recycling randomization at 
>W + 1 treatments. There were thirty subjects in each treatment. 
Stimulus Material 

A meaningful passagjf of approximately 800 words on vitamins was divided 
into ten paragraphs,- each of which was comprised of seven sentences. .Each 
sentence contained one main idea. Open-ended questions which could be 
correctly answered with one-to-three words, were constructed for each of the 
seventy sentences. 
Item Selection Procedure 

Each main sentence idea was incorporated into a question reprea/enting 

one of several topics such as names, measures, technical terms, or dates. The 

resulting seventy questions comprised the population or "domain*' ^of all items 

represented in the passage. Each paragraph contributed seyen questions to 

\ 

the item'^pool and, corresponds to a paragraph subpool of questions or a 
^ ''subdomain" of items. . 

Through the use of computer text processing programSj^^ forty questions 
were randomly selected from the domain of items for the acjjunct questions 
and for the postreading cr iter ion^measure . A set of forty items contained 
equal representation (n = 4) from the ten subdomains. The randomization 
procedure specified the random number generator to duplicate'^questions across 
treatments. The order of the questions in the criterion measure was further 
randomized to reduce the likelihood that any one item cou^ld be answered 
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merely because it duplicated the sequence of, material within the passage or 
other similar artifattual effect! Each subject within any condition received 
a unique set of questions but the same set of questions appeared ' in "each 
condition, and represented a replication of items across treatments. Thus, 
there was a^total of thirty different forms of the test' and adjunct questions* 
Procedure • . ^ ' * 

Students were permitted to sign up for an experimental session /convenient 
to their schedules. An average of seven subjects participated during any one 
session. Subjects reported to a , central area, where general instructions 
were delivered by the experimenter; Upon' answering questions if any existed, 
the experimenter hknded out the prerandomized booklets to the subjects in a 
clockwise order. The "test-only" subjects were requested to remain behind 
for further instructions. Subjects were required to find a room where they 

could feel comfortable stu<j[ying alone and to ^return once they finished so 

i 

that the criterion test could be administered. The need to ^^ollow instructions 
was highly stressed. The stimulus material was designed to be self-administered 
once the subjects received the booklets and recorded their time. The test- 
only subjects were given^^rtheF explanation asHto their role (to obtain a 
knowledge base on the ta(s;get pSpulatioh on the topic of vitamins so that 
performance could be compared to the remaining conditions). To ensure that 
subjects processed each adjunct question, he had to write the question (in 
paraphrase form) as well as answer it as each was encountered. ^ 

As each ^subject finished stt^dying the test, the finishing time was 

recorded and the booklet material was returned and exchanged for the corre- 

* . , * ' . . 

sponding criterion measure. When both parts of the. task were completed, 
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the experimenter inquired if (a) their role on the task was understood, 
(b) directions were followed and (c) progression through the stimulus material 
was in a^ forward direction only. If a "no" answer was suspected, the subject's 
data were discarded. A random check of twenty-five subjects was made to 

s. 

ensure that directions were being follbwexl. The data of four subjects were 
dropped because the subjects were suspected of violating one of the above 
. conditions. , - ^ - 

At the completion of the, tasks a brief explanation of previous findings' 
was delivered and an informative discussion usually followed, giving the 
experimenter deeper insight as to the processes involved. 

Results 

The initial question in need of answering was: Does randomly selecting * 
questions from a "domain" of items produced equivalent tests? The ANOVA 
procedures were applied to the thirty different pos^reading criterion measures 
for intentional, incidental and total pejrformance scores on five identical 
tests. All statistical tests indicated that the hypothesis of equivalent 
criterion measure could not be rejected, (all.^'s were greater than 0.58). 
The implications are that since the Kypothesis^df equivalent c^riterion 
measures cannot be rejected, likewise the belief that the item seleCtipn 
procedure produces equivalent tests cannot be rejected, ^e finding can now 
be interpreted as being caused by the treatment to which each subject was 
exposed. 

The "test-only"* subjects ' scores proved to be significantly lower 
(£ < 0.01) than the remaining scores. This suggests that the materials 
were appropriate for, the target population and that any c^iange from this 



ERIC 



\ 



. ^ , Additive Effects 

■ ' ■ - . • 10 

base knowledge can be attributed* to the treatment to which subjects were 

c 

exposed, (refer to Table 1) . . 

Total "intentional and Total Incidental Effects of I)uestions 

The data were . analyzed using a 2 x 4 analysis of varianc^e with two 
levels of type-of-learning (intent ionaj. and incidental) and four levels of 
question-placement; Since subjects in the no-question, conditioi^ did not 
encounter any' intentional items, a Value equal to the incidental items^was^ 
inserted for- the purpose of analysis ' (refer to Figure' 1) . 

The analysis resulted in a significant interaction between type-of- 
learning and placement-of-questions level, FC3,116) ^ 19.96, O.OOl, 
therefore, the Newman-^euls follow-up procedure was. used to test simple ^ 
effects. Performance was significantly better (£ < 0.01) for intentiona^l 
effects of QA and QBA subjects than th^ average performance on the remaining 
treatment grc^ups. Subjects in the prequestion group producecf significantly 
lower incidental learning (£ < 0.001) performance than all other subjects 
(X_ = 40*66). There* was no significant difference between ,tfie NoQ subjects 
(for both intentional and incidental) performance (X^^^** = 64.08) and the QB 
subjects •> intentional performance (X^^ = 67.83). ' As can be verified ^y th^ . 
data depicted in Figure 1, performance on intentional items was significantly 
higher (£ < 0.001) than incidental items for all subjects (except for the 
NoQ treatment group, of course). 

The fact that the NoQ subjects* intentional scores were replaced with 
their incidental scores caused the interaction to be sign!bficant in the above 
analysis. The QB, QA and QBA intentional scores were analyzed separately 
via a 2 X 3 ANOVA, to determine if, in faot, an interaction between factors 
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existed. The interac'feion was nonsfgnif icanC at the 0.01 alpha* level. As 





s 



a further test of the additivity model of peycformance, jthe. intentional 



performance was individually analyzed » using the hypothesized model in. 



. Equation 1. 



NoQ + |(QB - NoQ)! + |(QA - NoQ')| = QBA ^ (1) 
64.08 1069.7 - 64.08)1 + 1(79.0 - 64.08)| = 83.92 



The underlying assumption in the above analyses is that Since each subject / 
was randomly placed in a treatment group, ^he score was equally likely to 
occur in combination with any other subject, therefore the above equation 
could be applied. The actual mean score, when calculated for each replication, 
for the QBA subjects was 77.83, which does not depart significantly (£ < 0.05) 
from the hypothesized value of 83.92. As an added check on the above additive 
performance model, a test was carried out of the interaction component. As 
would be expected, the test for an interaction was found to be nonsignificant, 
[t(116) = -0.85, £ < 0.001], using the error term from the total intentional 
percentage scores analysis (MS = 388.10). The implication is that the 
effect of the QBA treatment approximates the effects of the additive combination 
of QB and QA according to the additive performance model depicted in Equation 1. 

The attention and retention operations, as discussed by Boyd (1973) 
were investigated within this study. Each subject's task included writing 
the adjunct question innnediately upon its encounter as well as writing the 
answer. This procedure was used to assure that questions were processed. 
All subjects were found to have followed these instructions. The data were 
analyzed using a 3 x 2 analysis of variance procedure, with three levels . 
o^ the between-subjects factor (QB, QA, and tJBA) and two levels of recall 



/; Addit,ive Effects 

12 

jjerformance (immediate reca^^ and postreading test recall), Ihe riesults 
are represented in Figure 2, and provide visual evidence *that there occurs 

» 

* (I ♦ . 

• an interaction between facttjrs (is also confirmed by the signifi(^ant interaction 
F(2,87) = 4.08, £ < 0.02). Since the question must be answered immediately 
after reading the relevant passage and supposedly no other event has taken 
place requiring the subjects' attention between presentation of stimuli and 
immediate recall, performance within the stimulus material provides an 
indication of the "attention" operation. How well the learner has attended 
to the material is directly reflected by this immediate recall. Performance 
on immediate recall is nonsignificant between the three conditions, however, 
the QA average perfoifmance is somewhat lower. . 

Performance on postreading criterion measure is significantly lower 
[F(l,87) = 118.97, £ < 0.001] than immediate recall of the same items. The 
QB performance is now significantly lower than both the QA and QBA conditions. 
Unfortunately we cannot extrapolate over time (beyond the postreading 
performance). This analysis signifies that attention is equal among the 
three conditions. What is not clear, however, is if processing among the 
conditions (depth of processing) is equal. Performance in the postreading 

-.criterion measure indicates that retention is poor (compared to QA and QBA). 
A surprising finding seems to be that although performances differ between 
the QB, QBA versus QA conditions in the immediate recall, performance on the 
postreading test by the QA and QBA subjects become equal and above the QB 
condition. 

A general conclusion one is led to make is** that the 'depth of processing 
for the QA and QBA is greater than the QB conditions. What we are unable to 
ascertain is if depth of processing differs between QA and QBA and between 
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immediate and postreading testing. The fact th^ performance actually : \ 

interacts does not tell us whether it is due to the attentivje operation or 
the forgetting operation. 

Adaptive Nature of Postquestioning ' ' , ✓ 

, ' ■ .. t< ■ i 

To test for the existence of trends in performance across the ten 
consecutive paragiwphs, the data for each subject was divided^ into a . 
performance 3cor^4or the first five paragraphs and a performance score for 
the last five paragraphs. The fluctuation in performance in any condition 
may be due to (a) differences in difficulty level of Che questions, 

(b) location of the question-relevant information within the passage, 

(c) the learners* attempts to "tune' in" on the "correct" irispeqtl'bn activities 
required for the task, (d) possible interference between the subjects' 
inspections habits and the inspection activities demanded of the learner by 
the experimental task, or (e) a combination of some or all of the above. ^ 
The analysis carried out were 2x2 analysis of variances with two within- 
subjects factors, (performance on paragraphs 1-5 versus performance on 
paragraphs 6-10, and incidental ^ersus intentional performance). The ' 
performance of subjects in each condition was analyzed separately. The 
postquestioning subjects were the only group to produce diverging performance 
(as can be verified in Figure 3) thereby indicating an interaction between 
the two factors, [F(l,29) = 10.01, £ < 0.004]. The conclusion which can be 
derived from such trends is that 4:he QA condition is causing learners to 
perform at a higher level in the latter half of material than on the first|^ 
half for intentional questions and the reverse is true for the incidental! i 
questions . ' ■ . 
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^ Discussion * '0' 

This fetudy clearly demonstrated differences in learning tjutcpmesii^- 
produced by variations in the location of 'adjunct questions embedded in 
textual materials V The results were in substantial agreement with-^the 
stated hypotheses, as well as with previous investigators. The heterogeneous 
sample of subjects provides for a greater generalizability of results than 
most related studies which haVe used a more restricted sample of the general 
population. 

Educators are constantly faced with the problem of what questions to ask 
so as to tap the learners' cognitive structure appiropriately to evaluate 
stated objectives.- A system of rules for generaeMjjp pool of everj possible 
test item of interest in a field of\knowledge has been developed (Hively, 
Patterson & Page, 1968; Hively, 1970). In selecting items to evaluate the 
learner, one would randomly sample from the pool, with the constraint that 
the test be made up of so many items from each unit (i.e., paragraph, page 
or chapter). Given the domain were properly constructed, such a prpcedure 
would reduce biasing to a chance level, and decrease the probability that 
only one type of question would be asked (i.e., name, measure, common phrase, 
date) or that the question-relevant information be found at the same, location 

within each unit of material. The item selection procedure was successfully 

\ 

demonstrated in the present study to encourage its future use. The procedure 
has the advantage of each subject being equally likely of-. re<?^iving any item 
and the ability to develop a unique test (yet equivalent test) for each subject. 
No-Questions (NoQ) 

Given that the subjects in the NoQ condition understand they are to 
expect a post-reading criterion test, attentive and retention behaviors are 
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believed to remain /onstant across paragraphs. Individuals have no way 

' ' / • ' 

of knowing eithe^/bef ore or after studying a paragraph^ what the appropriate 

attentive behayibrs are or what is important to attend to. The NoQ group 

would' attend/to all information equally , incorporating previously learned 

study skilXs and inspection behaviors taking into account stated, implied 

or perceived, task-appropriate instructions. The present investigations 

suppor^ the conclusion that performance on incidental items is expected 

to be,/ higher than subjects in other treatment groups because no interference 

is produced by having to deal with questions embedded in the text. 

Pr<&questions (QB) 

/ Prequestioning, evidently limits the range of attentive behaviors to. 
Question-relevant information only. The individual *kims the material for 
^the answer, and once the information necessary to answer the question has 
been located, the indivljdual recognizes it to be the answer to the question 
and concentrates on transferring the information into storage for later 
retrieval. Because information prior to the question has only been skimmed, 
thorough understanding of the peripheral (to central idea) material has not 
taken place, and the qiiestion-rel^v^nt information must now be ^'pieced 
together" from only partially attended material. The learner is unable to 
associate all question-related ideas to correctly answer the questions. Thi 
closely relates to the notion that the individual, upon encountering the 
information necessary to answer the ptequestion, recognizes it to be the 
answer without further processing of related, information and thus is reflect 
in the deflated incidental scores. This might appropriately be labelled the 
"Oh yes, here's the answer" phenomena. If storage is attempted, the 
information is stored^ in memory at the arbitrary level (i.e., rote. 
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associative or- episodic) . Bre^akdown may occur either in. the in^ility to ^ 

\, , ' '''t ' ' . ■- " ■ ■ 

store either part of or all' of thfe information, -if the individual is able 

to store the information, difficulty may arisg, in #efnembering the appropriate 

. ■ ' ■' ' ' ' ' ^ ■ ■ • ' ^ 

cues necessary toretri^ve^ it, (ineffective storage and retrieval). After ^ 

the target information has been located within the paragraph, the remaining 

portion of the paragraph may be skimmed much like earlier material or may /f 

*be skipped altogether, with the thought that having answered the preque^tioif^^ 

the task is complete. A characteristic of this search process results in 

depressed incidental ^item performance due to lack of at^£eDJtive behaviors . 

directed to inclcfental information. Intentional Item performance will not 

\ 

b4 as high as would be expected, due to the lack of a complete and meaningful 
experience (theme) attached to the information at the time of storage. In 
''short, organization of material and processing of the inf ormatiOR-^ hindered, 
. (or at least not aided)'. Other investigators (Frase, 1968c; Frase, et_ al. , 
1970) have suggested that prequestions serve as cues to identify relevant 
information and will cauSe an inhibition of responses to incidental stimuli, 
thus decreasing incidental learning. The evidence provided by this study 

/ 

leads to the conclusion that in the prequestian condition, inhibition of 

' 'i 

responses is also present in intentional learning, and is most likely due . 
to the above reasoning, \^ 
Postquestioning^(QA) 

In the postquestioning condition the individual is unaware a^ to. what 
shall be the demands, therefore, one proceeds to carefully attend equally to 
all information as in the Nop condition. When the question is encoHjntered 
at the end of the passage, a systematic search of the stored information 
takes place for the information necessary to answer the question. This 
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ition,tbut 



forces thW attentive behaviors to.be jequal to the NoQ condition, 'but the 
postquestion allows the Individual an added "practice trial". The added / 
practice atrial increases the probability that the same information is retrieved 
on^tlie postreading criterion measure provided, of coursg, it Was corectly 



retrieved immediately after .the paragraph. The forgettiirg rate decreases ^ 
(that is, less is forgotten) because of this practice trial for intentional 
information, but for the inciiiental information the rate of forgetting remains 
the same as in t^e NoQ cpntrcil group. The result is better organization of ; v 
informatian\ausing a more efficient retrieval process at time of posttest 
recall. According to Rothkopf and Bisbicos (1967) postquestions can modify 
mathemagenic behaviors by extinguishing And dropping ineffective behaviors^ < 
and strengthening successful performance. In concert with Rothkopf and 
Bisbicos, the da^a suggest that the jnathemagenic behaviors, at least for the 
QA condftion are adaptive: pei^forraance for intentional items progressively 
increases as performance' on incidental items progressively decreases. f 
Pre- and Postquestions (QBA) - The Additive Performance Model : ' 

One can speculate that if prequestions increase attentive behavior iand * 
postquestions increase retention of information due to the "practice trial" 
which forces greater processing and aids organization of information, then 
the net result is that the QB and QA processes additively combine to result 
in, the QBA performance. The individuals are hypothesized to attend to all 
information at the level equal to the QB condition because the subjects 
encounter the prequestion first and thus the "target" (correct) information is 
searched for. However, fealizin^ that a postquestion must also be dealt with, 
attentive behaviors equal to those of tlie QA subjects take over. In both 
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ca^es, the fact.^that the questions\ must be answeij^d again -tHe prai^t ice » 

trial .increases tme retention oF the question-relevaiit informatibn through , ;pr 

:^ . ■ - V ■ ' ' • > ■ ' ■ 7 

better organization^nd increased Iprocessing.- The strictly QB or QA 

attentive and retention behaviors ,do not adequately describe ^th^QBA \ §^ 

performance ajid jnust be modified. Modification of attentive J^j^vior^^ 



learning, 



lncremei;ital percentage scores of QB and QA; additiT)^eIJ^^M^ 

the QBA intentional performance. The QBA^rgani25atacf^ji|^£^^^^ implies \ 

the learner *s ability to take advantage of theJb^elN|^^ proces^s present 
in both preqiiestioning aiM postquestiojjiing eond^tiMjS. ' The. beneficial, 
processing by the QBA most likely woUld show up when recall would be measured 
in the more realistic situation of recall during delayed testing situation 
{a more realistic aim of/education) That is, to test for the retention of 
'information over an ^extended period of time. Thu^ better performance over 
time, due ''^to the more .thorough^procesgipg of the iftat^rlal would lead us to 
conclude that pre- and postquestloM-ng condition leads to ''processing advantag 



not found in other conditions, singly. 
Educational Implications . 



The evidence produced by the present experiment le^s. to recommending the 



proced^rje of constructing ap ^.tem pool on a doipaiii of' knowledge and randomly 
selecting questions t^fc|||.<)nj8truct individualized tests, "Tei^t ^processing 
computer programs similar to those used in t\ii.k exbeijtiipeat , may be used to 
facilitate suph a procedure. The use of a J^te^t-only" cont^^jl group is 
dbpolutely essential oh any learning exp^rimerital delsign thatl- deals with 
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connected discourse y ^o'as to ascertain the bpse knowledge of the target 
population on the stimulus material, at thje time of the experiment. The 
claim th^t one procedure is "better'* than a second or that it even produces* 
any effects which it may claim, must be verified by comparing it to the 
* control group representing the^ natural state of the population. The lack 
* of efficiency measures and the absence of proper control groups have been 
,two areas which have been criticized for not having been adequately attended 
to in the past (Faw & Waller, 1976). 

Adjunct prequestidns are detrimental to performance on i^ncidental items 
and are only ^slightly helpful on intentional learning. Past indications have 
been that frequent adjunct questioning interfere with incidental learning 

r 

(Frase, et al , > 19'70) , yet the NoQ control group's performance was found to 



J)e only slightly better (bulr^iot 9tatist«|||kly significant) , than all other 
question groups on ifncidental learning. ^Br 

The performance by subjects, j?^lative to serial position of paragraphs, 
appears to be erratic and extremely variable ^for most of the conditions. 
However > perform^ce fluctuates about the overall meaA score of the ten 
paragraphs and thus performance may roughly be described by the overall mean. 
The fact that performance is at the same level for paragraph number one as in 
paragraph ten refutes the claim that appropriate inspection activities are 
learned. The evidence suggests that the activities already exists within 
the individual and the learner merely mobilizes them into action. The post-, 
questioning condition is the exception to the above generalization^ demonstrating 
that ^he QA findings are in agreement with the adaptive inspection behaviors 
as discussed by Frase and Rothkopf and their associates. Although performance 

mc 
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(by the QA subjects) seems equivalent at^he beginning, there is a g^t^ong 
divergent trend, with intentional item performance increasing and incidental 
item performance decreasing with each successible paragraph. Logical questions 
to ask with respect to postquestioning inspection behaviors are: 

1. , How is this divergent trend affected by the number of units of 
material? 

2. How is efficiency related to each unit of material? 

3. What exactly are the causes pf this interaction effect? 

The importance of the additive performance model results are that it 
implies placing questions both prior to and after the question related passage., 
but more importantly helps to investigate the attention and retention operations 
claimed to be involved in adjunct question research. The fact that the QA and 
QBA conditions result in equivalent intentional performances, and the 'learner 
is exposed to twice as many questions also means that twice as many questions 
get answered c6rrectly. The "a-ttentive" operation is the same for all three 
conditions (although the depressed QA condition scores must be pointed out). 
The "retention" operation produces equivalent performance for QA and QBA, ^^jjj^ 
but a significantly lower QB condition performance. The Significance of 
this f indingv^suggests that the "attention" operation is not the important 
operation, but rather the "depth of processing" is, which QA and QBA conditions 
encourages the learner to under takWlFThe depth of processing (iirectly 
influences the retention of material over time. 

As a closing comment, we are led to make the following statement in 
relation to adjunct questioa research. Since the results of this 
investigation, as well as other previous research (see Anderson & Biddle, 
1975; Faw h Waller, 1976) not produce overwhelming evidence to the contrary. 



EKLC 



2n 



Additive Effects 

21 

it appears entirely reasonable to conQ^lude that th^ instructional outcomes 
of questions have not fully been reVe^ed, and must be if the intend is to 
use , questions only when they produce education, efficient, and desirable, 
outcomes. 
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TABLE 1 



/ 



Average Pertonnance For Each Set of Questions 



QUESTIONS 



Test-Qnly 



NoQ 



Treatment 

QB QA 



QBA 



Total Incidental 
Questions 

Total Intentional 
Questions 

Total Questions 



16.6 

16,6* 
16.6* 



6A.08 



64.08+^ 



64.08 



40.6 



69.7 



47.9 



58.6 



79.0 



63.8 



60.2 

77.8 
69.0 



I ^ ■ 

Performance is measured in percent of gprrect responses. 

* 

Subjects in the "test only" condition were not exposed to the stimulus material, but were 
given the criterion test. Items only in the final test, by definition, measure incidental " 
effects, but are assumed to measure intentional effects as well in the control group. 

+ 

All items in the NoQ treatment group measure incidental effects by definition, however, 
the intentional score is assumed to be equal to that of incidental items. 
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Figure 1: Total Intentional and Total Incidental Performance 

Across Treatment Groups 
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' Figurev 2: Performance indicators, ••attention" and "retention^ operation^. 

V Failure ^o find diffcntial affects on immediate .recall allows us to 
simplify our daU by using the "pooled" mean« This more clearly 
depict tWf non-differential effects, of attention and the diffential 

^ effects of retention* 
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